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5 Body movement monitoring system and method 



The present invention relates to a system and a method for monitoring body 
movement, in particular but not exclusively for evaluating the falling risk and/or for 
monitoring walking or running periods. 

10 

Falls are certainly the most common type of home accidents among elderly 
people and are a major threat to their health and independence. Studies have 
shown that in a sample of community-dwelling persons of 75 years and older, 
32% fall at least once a year. Among them, 24% sustain serious injuries. In 
15 addition, falling can dramatically change an elderly person's self-confidence and 
motivation, affecting his ability to function independently. Considering the growing 
part of very old people in the population of industrial countries (more than 47% of 
the elderly will be aged over 75 in 2006), falls will be one of the major problems of 
this important part of population. 

20 

Evaluating the risk of falling is important because it allows better providing 
adapted assistance and preventive measures to the concerned subjects. The risk 
of falling is generally evaluated by using a questionnaire that deals with problems 
of subjectivity and limited accuracy in recall or by clinical and functional 
25 assessment including posture and gait, independence in daily life, cognition and 
vision. 

Nyberg and Gustafson ("Patients falls in stroke rehabilitation. A challenge to 
rehabilitation strategies," Stroke, vol.26, pp. 832-842, 1995) reported that many 
30 falls in stroke patients occur during activities in which they change position (e.g. 
standing up, sitting down, or initiating walking). Although there are some studies 
about the relation of postural transition duration with the risk of falls, the methods 
of investigation used have serious limitation since they consist in performing tests 
under the constraint of laboratory and instruments such as force-platform. 

35 

Quantifying daily physical activity is a determining factor for evaluating the quality 
of life of subjects with limited mobility, e.g. in old age. Operative procedures and 
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5 pathology, such as joints dysfunction and cardiovascular impairment, limit the 
patient's mobility and physical activity. A reliable measurement of the physical 
activity in everyday life would allow a better assessment of the utility and the 
relevance of a number of medical treatments. Continuous 24-h recordings of 
posture and motion can be generally useful in behavior assessment. The nature 

10 of postural transitions between standing, sitting and lying allow to categorize the 
type of activity and also to better understand problems occurring during daily 
activity (difficulty during rising from a chair, falling, etc,). The ability to sit and to 
stand may also be regarded as a physiologically essential function in human 
beings and a prerequisite for gait. In the past, the ambulatory measurement of 

15 physical activity often relied on the use of an accelerometer strapped on the waist, 
the wrist, or the ankle (see e.g. Patterson S.M., Krantz D.S., Montgomery L.C., 
Deuster P.A., Hedges S.M. and Nebel L.E., "Automated physical activity 
monitoring : validation and comparison with physiological and self- report 
. measures", Psychophisiology, Vol. 30, pp. 296-305, 1993. NG A.V. and Kent- 

20 Braun J. A., "Quantitation of lower physicalactivity in persons with multiple 
sclerosis", Med. Sci. Sports Exerc, Vol. 29, pp. 517-523, 1997), but these 
methods provide no information on the type of activity. Recently new systems 
have been developed to identify the type of activity (K. Aminian, Ph. Robert, E.E. 
Buchser, " Physical activity monitoring based on accelerometry: validation and 

25 comparison with video observation", Medical & Bio. Eng. & comp, vol. 37, pp. 1-5, 
March 1999), but these methods are based on two different sites of attachment 
and due to discomfort caused by sensors and cable fixation, in certain cases, are 
not easy to use during long term monitoring of physical activity. 

30 The above cited problems are overcomed in the present invention which concerns 
a body movement monitoring system comprising : 

- a sensor to be attached to the trunk of a subject, 

- processing means for deriving information from said sensor, 
35 - display means for displaying said information to an operator, 
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5 wherein said system includes mearls for determining the time of postural 
transition. 

Preferably the sensor comprises a miniature gyroscope. 

10 In the present text, the expression "postural transition" is defined as the 
movement performed during a sit-stand or a stand-sit transition (e.g. rise up from 
the chair, sit down the chair). 

In an embodiment of the invention, the system also includes means to determine 
15 the duration of postural transition. As shown hereafter such a configuration allows 
the estimation of falling risk from ambulatory monitoring and during the daily life in 
elderly subjects. This results in an improvement in their life quality. 

In another embodiment of the invention, the system also comprises a vertical 
20 accelerometer. As shown further in the text this additional element allows the 
monitoring of a complete physical activity, namely the detection of body postures 
such as sitting, standing and lying together with walking or running state. It should 
be pointed out that all these detections are carried out by a single sensor attached 
to the trunk (preferably on the chest). 

25 

In another embodiment of the invention, the system also comprises alarm means 
which are activated when the quality of postural transition is behind a threshold. 
The quality of postural transition is assessed using three parameters, namely the 
average and standard deviation of postural transition duration and the occurrence 
30 of abnormal successive transitions. 

The invention will now be described by way of examples using the following 
figures : 

35 Figure 1 illustrates postural transitions 

Figure 2 illustrates a basis function used for a wavelet analysis 
Figure 3 shows a flow chart of the algorithm used in example A 
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5 Figure 4 represents a first view of the results of example A 
Figure 5 represents another view of the results of example A 
Figure 6 shows a comparison for different postural transitions with a reference 
system 

Figure 7 illustrates a situation where several postural transitions occur 

10 immediately one after the other 

Figure 8 represents the sensors attachment in examples A and B 

Figure 9 shows a vertical displacement (a) and the corresponding acceleration (b 

for sit-stand and c for stand-sit) in example B 
Figure 10 illustrates the wavelet algorithm used with example A and B 

15 Figure 1 1 shows the efficiency of the wavelet analysis 

Figure 12 shows differently the efficiency of the wavelet analysis 
Figure 13 shows a comparison between our sensor (Gyroscope) and a reference 
system (Vicon™). 

Figure 14 shows the efficiency of the wavelet analysis for walking sequence 
20 enhancement. 

Figure 15 shows a physical activity classification 
Figure 16 shows a first trunk tilt estimation 
Figure 17 shows another trunk tilt estimation 

25 Example A : Falling risk evaluation in elderly 

METHOD 

A. Experimental design 

30 

Eleven subjects older than 65 were studied. Written informed consent was 
obtained from all the subjects, and the ethical committee of the University of 
Geneva approved the protocol. A medical history was obtained including 
medication use and history of falls during the preceding year. A standardized 
35 mobility assessment testing static equilibrium and gait was performed according 
to Tinetti (ME Tinetti, TF. Williams, R. Mayewski, " Fall risk index for elderly 
patients based on number of chronic disabilities," Am. J. Med., vol. 80, pp. 429- 
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5 434, 1986). A fall risk score was obtained by addition of subscores of known risk 
factors forfaits, shown in table 1. 



The final score was normalized between 0 (lowest risk) and 10 (highest risk). 
Subjects were divided into two groups: falters and non-fallers. If a patient had fall 
10 risk score higher or equal to '5\ he was classified as faller and else non-faller. 



Each subject performed different activities involving postural transitions (such as 
Stand-Sit: SiSt, Sit-Stand: StSi) and dynamic activities (walking) with use of 
different type of chairs (standard wood chair, armchair and upholster chair) with 
15 and without use of armrest. The protocol of the measurement is presented in table 
1. For each test, the subjects were asked to sit down and stand up three times. 



TABLE 1 

FALL RISK SCORE 

20 



Parameters 


Score 


History of falls in the preceding year 


No = 0/Yes =2 


Static equilibrium disturbances 


No =0 / Discrete =1 / Marked =2 


Gait disturbances 


No =0 / Discrete =1 / Marked =2 


Troubles of vision 


No =0 / Discrete =1 / Marked =2 


Troubles of cognition 


No =0 / Discrete =1 / Marked =2 


Troubles of mood 


No =0 / Discrete =1 / Marked =2 



TABLE 2 

DIFFERENT TESTS PERFORMED BY EACH SUBJECT 

25 



Test 


Type of Activity 


Type of Seat 


1 


Sit to Stand + walking + Stand to Sit. 


Upholster without armrest 
(Seat Height: 48 cm) 


2 


Sit to Stand + Stand to Sit 


Armchair with armrest 
(Seat Height: 46 cm) 


3 


Sit to Stand + Stand to Sit i 


Wooden chair without armrest 
(Seat Height: 46 cm) 


4 


Sit to Stand + Stand to Sit 


Upholster chair without armrest 
(Seat Height: 48 cm) 


5 


Sit to Stand + Stand to Sit 


Wooden Chair with armrest 
(Seat Height: 46 cm) 
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5 B. Portable measuring device- 
Trunk tilt needs to be recorded for the successful identification of body posture 
transition. This trunk tilt corresponds to the angle '0' between the vertical axis and 
the subject's anterior wall of his thorax. In order to estimate 6 a piezoelectric 
10 gyroscope (Murata, ENC-03J, ±400 deg/sec) was attached with a belt in front of 
the sternum. The angular rate signal was amplified, low-pass filtered (17 Hz),, 
digitized (12 bit) at a sampling rate of 40 Hz by a portable data logger (Physilog, 
BioAGM, CH) and stored on a memory card. At the end of the recording the data 
were transferred to the computer for analysis. 

15 

C. Reference method 

A standard motion analysis system (Vicon™, Oxford Metrics, UK), was used as 
reference. Five infrared cameras arranged around the subject and four retro 

20 reflective markers placed one on the left acromion, one on the sternum 
manubrium and 2 on the belt holding the kinematic sensor, on each side of it. 
These markers have allowed an accurate 3D measurement of the chest 
movement. Trunk tilt and displacement of the gyroscope were calculated from the 
3D components of the markers. The sample frequency of the recording was 50 

25 Hz. 

D. Postural transition estimation 

Fig. 1 shows that during both SiSt and StSi transition, there is first a leaning 
30 forward followed by a leaning backward. In order to estimate the time of postural 
transition: PT, first the trunk tilt, '9', was calculated by integrating the angular rate 
signal measured by the gyroscope. Then the sin(9) was calculated and its 
minimum peak was considered as PT. The postural transition duration: TD, was 
calculated by estimating the interval time between the beginning of leaning 
35 forward and the end of the leaning backward. The estimation consisted to detect 
the maximum peaks before and after PT. Considering these two peaks 
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5 respectively by and P 2 , and their corresponding time by t(Pi) and t(P 2 ) f TD was 
estimated as follow: 

TD^P^tfPi) 

1 0 E. Wavelet Analysis 

One of the drawbacks of integration from piezoelectric gyroscope is the presence 
of drift in the measured signal. In order to cancel this drift and to prevent other 
noises such as movement artifacts, which do not relate to posture transitions, 

15 discrete wavelet transform (DWT) based on Mallat algorithm was used as filtering 
method. This new tool differs from the traditional Fourier techniques by the way in 
which they localize the information in the time-frequency plane. In particular, it 
allows trading one type of resolution for the other, which makes them especially 
suitable for the analysis of nonstationary signals such as human motion signals. In 

20 this method, it is possible to analyze the signal in both of the time and frequency 
domains. This is an important aspect to detect the desired band frequency related 
to body posture transition. In other words, the important aspect of trunk tilt signals 
is that the information of interest is often a combination of features that are well 
localized in time and frequency domains. This requires the use of analysis 

25 methods sufficiently versatile to handle events that can be at opposite extremes in 
terms of their time-frequency localization. Moreover, this method allows using a 
suitable basic function, which is more similar to the pattern trunk tilt during 
transition. An example of a basic function is given in fig. 2 for various dilation 
factors. Each of these functions has similar basic shapes and cyclic variations. 

30 

A multi-resolution transform is used to approximate the signal with different 
resolutions. It consists to split a signal into high-scaie (low-frequency components) 
called approximation and low-scale (high-frequency components) called the detail. 
The decomposition is iterated, with successive approximations (or details) being 
35 decomposed in turn, so the original signal is broken down into many lower- 
resolution components. At each decompositions scale the number of samples in 
the time domain is decreased by throwing away every second sample (down 
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5 sampling with a factor of '2'). By considering the original signal s(n) (i.e. sinus of 

trunk tilt), the approximation of the signal at scale j=0 \$A 2 oS which corresponds 

to the original signal s(n). At each new decomposition the approximation and 
detail loss in resolution since at each scale 2 samples will be replaced by one. At 

scale j the A^s represents approximation of s(n) with a resolution of one sample 

10 for every 2 1 samples of the original signal. 

Mallat showed that using a suitable low-pass filter h t and a high-pass filter g, the 
approximate signal A 2 ^ x s and detail signal £> 2 y+iScan be further written as 
following: 

15 

+00 
+CO 

The coefficients of h and g filter are associated with the shape of wavelet 
20 considered for the analysis. In this study, decomposition into 10 scales with the 
'Coiflet order 5' wavelets has been used. 

In addition these wavelets can be implemented very efficiently using standard 
decimated (or non-decimated) filter-bank algorithms. . 

25 

F. Algorithm 

A flowchart of our algorithm is summarized in fig. 3. First, signal of gyroscope was 
. segmented to one-minute duration packs. Then the signal was integrated and 
30 sin(9) was calculated. In order to cancel the drift of integration and movement 
artifacts, wavelet analysis was applied. For each postural transition, the 
approximation corresponding to (A^s-A^s ) was chosen. The values of k and I 
correspond to scales, which provide the best approximation of StSi and SiSt 
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5 transitions. PT and TD were estimated Yrom sin(8) as' described earlier. In the end 
of each test the mean of TD (M_JD) and its standard deviation (A_TD) were 
calculated. 

In order to test the significance of the TD for the evaluation of risk of falling, T-test 
10 was used between the parameters obtained for taller and non-faller groups. 

RESULTS 

Fig. 4 shows the time-scale contour-plot of sin(8) obtained from the gyroscope 
15 compared to that measured with Vicon. The result shows that the best scale to 
extract relevant information correspond to the difference between course signals 

in scale k=5 and 1=9 (-^2 5 f ~ ^2 9 f )• This band frequency corresponding to 
0.04-0.68 Hz was chosen for the DWT. 

20 Fig. 5(a) shows a typical sin(0) obtained from the integral of angular rate rotation 
during several SiSt and StSi transitions. This figure shows a typical problem due 
to integration drift, which is canceled after DWT (fig.5(b)). In addition, superfluous 
peaks, which do not belong to transitions, can be observed in fig. 5(a). These 
peaks were caused by movement artifacts during transition. In fact in some case, 

25 especially in subjects who have difficulty to rising from a chair, an oscillatory 
movement is superimposed on the measured signal. Since PT detection is based 
on peak detection, the presence of these peaks can produce some errors in 
transition detection. As shown in fig. 5(b) these peaks were canceled by the DWT 
while the true transitions were significantly enhanced. 

30 

Fig. 6 compares for 6 postural transitions, a typical pattern of the displacement 
and sin(6) obtained with Vicon™ with sin(0) obtained from the gyroscope. 

These results show that the estimated transition durations correspond to the true 
35 transition period observed with Vicon™. There is a close agreement between the 
two systems. The coefficient of correlation between sin(6) estimated from the 
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5 gyroscope and that obtained from Vicon™ system varies between 0.90 and 0.99 
depending on the performed test. 



Table 3 shows for each subject the values of M_TD and A_TD through all of the 
activities and the corresponding fall risk score. Expectedly, the non-faller group 
10 (fall risk score 0-3) was younger (75.5 +/- 3.39 years) than the faller group (fall risk 
score 5-10, 79.8 +/- 8.98 years). 



TABLE 3 

SUMMARY OF THE RESULTS PER SUBJECTS 

15 





Subject 


M_TD 
(sec) 


A_TD 
(sec) 


S_Trs 


Falling 
Risk Score 




1 


3.85 


1.343 


14 


10 


O 


2 


4.97 


1.665 


5 


9 


la 


3 


3.27 


1.018 


5 


8 


LL 


4 


4.16 


1.262 


0 


5 




5 


3.17 


0.930 


0 


5 




6 


3.24 


0.593 


0 


0 


1— 


7 


2.96 


0.576 


0 


0 




8 


2.92 


0.549 


0 


1 


c 


9 


2.94 


0.729 


0 


1 


o 


10 


2.52 


0.371 


0 


3 




11 


3.14 


0.959 


0 


2 



Fig. 7 shows a special case where several PTs occurring one immediately after 
the other while subject trying to stand or sit. This event called "successive 
transition" shows how many times a subject tries to make a PT but he/she unable 
20 to do it. The occurrence of "successive transition" is noted by S_Trs in the table 3. 
In fallers group, this parameter is increased with falling score while in non-fallers 
S_Trs is always null. T-test performed between fallers and non-fallers groups 
show a significant increase of M_TD (p<0.02) and A_TD (p<0.002). 

25 The above cited example has shown that, based on a simple model and an 
appropriate DWT, three parameters (i.e. M_TD, A_TD and S_Trs) for evaluating 
the falling risk have been provided. 

The comparison between the two groups of elderly subjects (i.e. fallers and non- 
30 fallers) shows that M_TD and A_TD in different PT (whatever the type of chair) 
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5 are significant parameters for discriminating between these two groups. In 
addition the occurrence of "successive transitions" is a third parameter, which is 
correlated to the fall risk score. These parameters correspond to one or two 
attempts before succeeding in standing up from a seat. These attempts due to 
muscular weakness or joint stiffness are indicative of a higher risk of falls during a 

10 very simple daily life activity. It is important to note that both normal and 
"successive transitions" have been accurately classified (sensitivity more than 
99%). 

The type of PT (i.e. SiSt or StSi) did not change significantly as regards TD, 
15 therefore seems to have no specific role in the evaluation of falling risk in our 
tests. Table 4 shows the values of TD corresponding to SiSt and StSi for fallers 
and non-fallers groups. Although MJTD and AJTD are significantly different for 
fallers and non-fallers groups, within each group these values do not change 
significantly (p>0.4) with the type of transition (StSi or SiSt). It is clear that, if the 
20 type of transition were important, an improvement of the method would be 
necessary in order to classify the type of the posture. This classification could be 
made for instance by adding a vertical accelerometer on body trunk. 

Although the results presented in this example concern short recordings involving 
25 a limited number of PT, it is important to note that the system can be used for a 
long term monitoring. The batteries lifetime and memory card allows monitoring 
up to 24 hours. If necessary, the datalogger can be recharged quickly and 
memory card replaced for a new recording. Contrary to stationary system such as 
video motion analysis or force-plate system, the proposed system allows 
30 measurement outside of the laboratory, in ambulatory and daily life conditions. 
The system does not hinder the subject since only one miniature sensor is used 
that can be attached everywhere on the trunk and the recorder is very light. The 
integration of the sensor and the recorder in a same module allows providing a 
system especially adapted for ambulatory instrumentation and tele-alarm 
35 systems. 
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5 By considering the values of the estimated parameters during each day and their 
change over repeated measurements, the device can be considered a promising 
tool in home health care of elderly by giving objective figures of mobility of old 
people either healthy or suffering from specific conditions. Additionally, this device 
can be considered as a tool for an objective assessment of the fall risk and its 

10 change in elderly subjects during rehabilitation programs. 

TABLE 4 

TEMPORAL POSTURAL TRANSITION PARAMETERS FOR FALLERS AND 

NON-FALLERS GROUPS 



Temporal 
parameters 


Fa 


ler 


non- 


-aller 


SiSt 


StSi 


SiSt 


StSi 


M_TD 

(sec) 


3.73 


3.93 


2.90 


2.95 


AJTD (sec) 


1.06 


1.05 


0.47 


0.54 



Example B : Physical activity monitoring 
METHODS 

20 

A Experimental setup 

11 elderly-Community dwelling subjects (6 females, 5 males, age 79±6 years) 
carrying a kinematic sensor on the chest performed 6 tests involving various 

25 postural transitions and dynamic activities (table 5). Written informed consent was 
obtained from the subjects. During walking, some subjects have used a cane. The 
kinematic sensor was composed of one miniature piezoelectric gyroscope 
(Murata, ENV-05A, ±400 deg/sec) measuring trunk angular velocity (g s ) in the 
sagittal plane and one miniature accelerometer (ADXL02, ±2g), measuring vertical 

30 trunk acceleration (a v ). The gyroscope, the accelerometer and their conditioning 
electronic were packaged in a very small box and attached on the chest. Signals 
were digitized at 40 Hz sampling rate and recorded by a light portable data logger 
(Physilog, BioAGM, CH) carried on the waist. 
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5 The results of each test were validated using 5 cameras and 4 retro reflective 
markers placed on the trunk (Vicon™, Oxford Metrics, UK). This optical system 
allows an accurate 3D capture of chest movement (Fig.8). Three additional tests 
were performed with elderly subjects carrying the system for one hour in hospital 
building and outside, while an observer noted the actual activity of each subject. 

10 

B. Lying detection 

The recognition of the lying posture from sitting and standing was performed by 
considering the orientation of the accelerometer with respect to the direction of 
15 gravitational acceleration (vertical axis). In lying posture, the accelerometer 
measures almost zero g while in sitting and standing it shows around 1g. 



TABLE 5 

DIFFERENT TESTS PERFORMED BY EACH SUBJECT. 



Test 


Type of Activity 


Type of Seat 


1 


Sit + Lying + Sit + Stand + 
walk 


Bed 

(Desired Heiqht for each subject) 


2 


Sit to Stand + walking + 
Stand to Sit 


Upholster without armrest 
(Seat heiqht: 48 cm) 


3 


Sit to Stand + Stand to Sit 


Armchair with armrest 
(Seat heiqht: 46 cm) 


4 


Sit to Stand + Stand to Sit 


Wooden chair without armrest 
(Seat heiqht: 46 cm) 


5 


Sit to Stand + Stand to Sit • 


Upholster chair without armrest (Seat 
height: 48 cm) 


6 


Sit to Stand + Stand to Sit 


Wooden Chair with armrest 
(Seat heiqht: 46 cm) 



C. Sitting and standing detection 

25 The main problem of posture discrimination concerns the separation of sitting and 
standing postures. Sitting occurs at the end of the stand to sit transition ('StSi') 
while standing occurs at the end of the sit to stand transition ('SiSt'). As a result, 
the identification of these two transitions is sufficient to recognize sitting and 
standing postures. The acceleration a v during SiSt (resp. StSi) transitions was 

30 described using a simple kinematic model. Fig.1 shows that during both SiSt and 
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5 StSi transition, there is first a forward lean followed by a backward lean. This tilt 
looks like a half period of sinusoid function where the minimum corresponds to the 
time of postural transition: PT. In order to estimate this time, first 9 (the trunk angle 
in the sagittal plane) was calculated by integrating g s . Then the sin(9) was 
calculated and its minimum peak was considered as PT. The postural transition 

10 duration (TD) was calculated by estimating the interval time between the 
beginning of forward lean and the end of the backward lean. Fig.9 shows, the 
nature of the vertical displacement during SiSt (also StSi) and the corresponding 
accelerations obtained from second derivative of the displacement. SiSt 
generates an acceleration peak (positive) followed by a deceleration peak 

15 (negative) while the inverse occurs for the StSi. Therefore, the pattern of a v during 
the TD can be used for SiSt and StSi estimation. 

The important aspect of trunk tilt and acceleration pattern of posture transition is 
that the information of interest is often a combination of features that are well 
20 localized temporally or spatially. This requires the use of analysis methods 
sufficiently versatile to handle events that can be at opposite extremes in terms of 
their time-frequency localization. In trunk angular velocity, there are several 
peaks, which are not related to the posture transitions and make difficult the 
detection of the true pattern of PT. Moreover, computing 9 from the integral of g s 

25 involves drift in the measured signal. In order to cancel the drift and to prevent 
other noises such as movement artifacts, which aren't related to posture 
transitions, Wavelet analysis based on Mallat algorithm was used. This algorithm 
is based on two dedicated filters H(co) (Low-pass filter) and G(©) (High-pass filter) 
has been presented in fig.10. At each scale j, the signal is divided into low 

30 frequency component (approximation: A 2 j ) and high frequency component (detail: 
D 2 J ) and loses in resolution because of downsampling. At scale j, A^ represents 
the approximation of the original signal with a resolution of one sample for every 2 j 
samples of the original signal. In our algorithm, since all of the samples in time 
domain are needed, instead of down sampling in time domain the frequency band 

35 is divided by 2 in each step j. This new tool differs from the traditional Fourier 
techniques by the way in which they localize the information in the time-frequency 
plane. In particular, it allows trading one type of resolution for the other, which 
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5 makes them especially suitable for the analysis of nonstationary signals such as 
human motion signals. Moreover, this method allows using a suitable basic 
function (mother wavelet), which is more similar to the pattern of trunk tilt and 
acceleration during posture transition. The approximation of g s between scales 5 
and 9 (A 2 5 - A 2 9 ) was used for TD detection. The band frequency corresponds to 

10 0.06-0.45 Hz. The a v approximated signal between scales 5 and 6 (A 2 5 - A 2 6 ) was 
used for SiSt or StSi recognition (band frequency: 0.34-0.68 Hz). For each 
approximation, 'coiflet' mother wavelet with order 5 was used. 

D. Walking detection 

15 

In order to detect the walking state, a v was analyzed every 5 seconds. Wavelet 
decomposition was also used to enhance the walking pattern and to reduce noise 
and drift arising from other activity such as posture transitions, turning or motion 
during standing posture. The approximated wavelet signal, DWT(a v ), between 

20 scales 2 and 5 (A 2 2 - A 2 5 ) was considered. A Daubechies mother wavelet with 
order 4 was applied. The band frequency corresponds to 0.68-5.47 Hz. For 
obtaining the pattern of walking, negative peaks beyond a fixed threshold were 
detected. Successive peaks agreeing a time difference of 0.25 to 2.25 s belong to 
walking step and were chosen as candidate peaks. We assumed that a true 

25 walking signature has at least 3 steps during each 5s interval. Then if more than 
three peaks were detected, these peaks were considering as walking steps. 

E. Physical activity classification 

30 By using the above algorithms physical activity was classified. However in order to 
improve this classification and reduce the false detection the following rules were 
considered: 

- If two contradictory states were detected (e.g. lying with walking or sitting with 
35 walking), preference was given first to lying then to walking and finally to StSi or 

SiSt transition. 

- Two successively SiSt (or StSi) detections were not considered as correct. 
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5 - Leaning backward during standing state was considered as inconsistent for 
elderly. 

RESULTS 

10 

Fig. 11 and 12 show the efficiency of the wavelet analysis for SiSt and StSi 
detection. As illustrated, the nearest peaks in DWT(a v ) in respect to the local 
minimum of sin(9) are correctly detected. Negative peak is followed by the positive 
one during SiSt transition (fig.H.c) while the inverse occurs for StSi transition 

15 (fig,12.c). The similarity of data obtained from the kinematic sensor and the 
Vicon™ system was high (0.90<r<0.99) as shown in fig.13. Among 287 postural 
transitions performed by all of the subjects, a sensitivity of 99% was obtained for 
detection of postural transition. The sensitivity and the specificity for sitting and 
standing classification have been shown in table 6. During tests 1 and 2, which 

20 involve walking and lying period, these parameters were more than 90%. In our 
tests all lying and getting-off from the bed periods were correctly classified. 

Fig. 14 shows the effectiveness of wavelet analysis for walking sequence 
enhancement In this figure, all peaks belonging to walking steps detected by the 
25 reference system (Vicon™) are marked. It can be seen that the drift in a v signal is 
reduced in DWT(a v ) while the actual walking peaks have been enhanced, which 
let to a better peak detection. 

These advantages of wavelet transform allow preventing any calibration for each 
30 subject. The sensitivity for walking period detection was more than 95%. 

Fig.15 shows a typical physical activity classification obtained during one hour of 
recording for an elderly. In this test, there isn't any reclassification and the 
results correspond entirely to the observer notes. In two others tests performed 
35 during one hour with two other elderly, the sensitivity for detection of lying, SiSt, 
StSi and walking state were more than 90%. 
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10 



This example has shown the possibility to categorize body postures and walking 
state with help of only one miniature sensor causing no discomfort for the subject. 
All results were validated using a standard reference system in a gait laboratory. 
The results show also that wavelet transform is a powerful technique to detect 
postural transition and to analyze walking pattern. The walking detection has a 
high sensitivity even, when subjects use walking aids such as cane. In addition, 
no calibration is needed according to each subject. 



15 



20 



The results show that during the tests 3, 4, 5 and 6, which do not involve walking 
and lying, the sensitivity is lower than for the tests 1 and 2 where a period of 
walking or/and lying is included. This is essentially due to the correction made in 
PT from the walking and lying state detection. This confirm our assumption 
according to which in our classification, the priority is given first to lying then to 
walking and finally to StSi or SiSt. Furthermore during daily life, lying posture and 
specially walking state are often present. 



TABLE 6 

SENSITIVITY AND SPECIFICITY OF TRANSITION DETECTION 



E 



1 

2 
3 
4 
5 
6 

Mean 



& 
.o 



40 
65 
58 
52 
56 
56 
57 



Sensitivity 



t- 

CL 



100 

97 

100 

98 

100 

100 

99 



to 
to 



91 
83 
54 
54 
75 
71 



CO 



97 
83 
77 
89 
86 
86 



D) 

c 



100 



100 



O) 

c 

J* 

I 



95 
97 



96 



Specificity 



to 

tO 



97 
86 
80 
81 
80 
85 



(Q 
CO 



94 
86 
54 
58 
77 
74 



25 . . This method offers a promising tool for long term and home care monitoring of 
daily physical activity. It may to better appreciating the quality of life of patients 
with disability by quantifying their degree of mobility. This system may also be 
used for assessment of risk of fall in elderly. 
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5 

Example C : Absolute Trunk tilt calculation. 

Estimation of forward trunk angle (tilt) can be useful for qualifying each activity. 
Finding of this parameter can be also useful for the correction of activity quality. 
10 For example having a correct angle can be important for facility of posture 
changing or having a successfully transition on the bed. Study about correlation of 
trunk tilt with lower member such as hip and leg is also useful for assessing the 
quality of body posture transition and could be considered as a falling risk 
parameter. 

15 The measured frontal acceleration can be expressed as: 

a facc. = a f C0S # + Ov + g) s ™Q (1) 
Where : 

afacc< = Measured signal by frontal accelerometer. 
af= Inertia! frontal acceleration 
20 a v = Inertial vertical acceleration 

g= Gravity acceleration. 

0= Absolute angle (tilt) of body trunk surface (Place of sensor attachment). 

For finding the absolute tilt, signal of accelerometer, which has been attached on 
25 body trunk surface in frontal direction, is anaiyzed. Measured signal by frontal 
accelerometer has two components consisting of frontal and vertical 
accelerations, which arise from inertial body movement and gxsin(B), which arise 
from gravity acceleration (equation 1), 

30 From equation 1, it is clear that when af=0 and a v ~0, the accelerometer signal is 
related to only absolute trunk tilt value (afacc= gxsin(G), if af=0 & a v =0). In other 
word with measuring the acceleration signal in frontal direction in the situation of 
zero inertial acceleration, calculation of the absolute tilt will be possible. Moreover 
it can be assumed that the period where variance of v af^ is lower than a dedicate 
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5 threshold, and a v are around zero (gxsin(9), has a zero variance since 9 

has around a constant value). Therefore the absolute tilt in case of no-movement 
(acceleration variance about zero) such as sitting, standing and lying in a rest 
state can be estimated by calculation of the sin(8) from frontal accelerometer. For 
estimation of absolute tilt value in other case (activity with high variance), 
10 gyroscope signal is used as follow: 

0= jG*+G(/ 0 ) (2) 

'o 

Where : 

6= Body Trunk absolute angle. 
15 G= Angular rate measured by gyroscope. 

t 0 = Initial time 

8(t 0 )= Initial trunk tilt value in t=to. 

It is clear that if there is one value of absolute tilt in any time, the absolute trunk tilt 
20 can be calculated over the time from above equation too. For finding of this initial 
value the mentioned method for calculating of l 0' by frontal accelerometer is used. 
Then with combination of an accelerometer and a gyroscope, which are placed on 
the body trunk and the above method, absolute trunk tilt can be estimated. Two 
sample of absolute trunk tilt estimation for two different activities have been 
25 shown in fig. 16 and 17.. af^ and trunk angular rate measured by gyroscope 
have been shown on fig. 16 (a) and (b). Fig 16 (c) and (d) show the absolute trunk 
tilt and variance of respectively, calculated by this method during sit-stand 
and stand-sit transition Fig. 17 shows the same parameters on fig.16 for lying, 
walking and getting up from the bed activities. 

30 

In addition, by using a vertical accelerometer the value of inertial acceleration can 
be estimated as follow: 
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5 av acc = (a v +g)cos$-a f sin9 (3 ) 

Where : 

av aC c-= Measured signal by vertical accelerometer. 
Knowing the a v is useful for calculating of vertical velocity and displacement and 
knowing af is useful for calculating of frontal velocity and displacement. 

10 

It should be understood that this invention is not limited to the examples or 
embodiments herein disclosed but comprises all modified forms as come with in 
the scope of the following claims. 
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> Claims 



1 . A body movement monitoring system comprising : 

- a sensor to be attached to the trunk of a subject, 

10 - processing means for deriving information from said sensor, 

- display means for displaying said information to an operator, 
characterized by the fact that said system includes means for 
determining the time of postural transition. 

15 2. A monitoring system according to claim 1 wherein the sensor comprises 
a miniature gyroscope. 

3. A monitoring system according to claim 1 or 2 wherein said system 
includes means to determine the duration and the type of postural 

20 transition. 

4. A monitoring system according to any previous claim comprising alarm 
means which are activated when the quality of postural transition is 
behind a threshold. 

25 

5. A monitoring system according to any previous claim comprising 
furthermore a vertical accelerometer. 

6. A monitoring system according to claim 5 comprising furthermore a 
30 forward accelerometer. 

7. Method for measuring the time of postural transition in using the device 
of any claim 1 to 6 wherein the trunk tilt 9 is first calculated by 
integrating the angular rate signal measured by said sensor, sin 8 is 

35 then calculated, the postural transition corresponding to the minimum 

peak of sin 6. 
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5 8. Method according to claim 7 v wherein the duration of postural transition 
is based on the duration between the maximum peaks of sin 9 which 
occur before and after the time of postural transition. 

9. Method for evaluating the falling risk in using the device of any claim 3 
10 to 6 wherein said falling risk is determined by a combination of three 

parameters, namely the average and standard deviation of transition 
duration and the occurrence of abnormal successive transition. 

10. Method for monitoring physical activity, particularly the sitting, standing 
!5 and lying states, walking and running periods, using the device of any 

claim 5 or 6 in relation with claim 3 wherein the vertical accelerometer is 
used for measuring these activities. 

20 



1/17 



PCT/CH01/00590 




WO 02/28282 



2/17 



PCT/CH01/00590 




WO 02/28282 



PCT/CH01/00590 



3/17 



Gyroscope 

— > 



lmin. 
Segmentation 



I 



J 



Calculation of . 
sin(6) 



DWT 




Detection of PT with dedicate 
threshold 



Estimation of TD, SJTrs 



Fig. 3 



WO 02/28282 



4/17 



PCT/CH01/00590 



O 
0) 
(/) 

O 

E 



200- 



100: 



r ttt.'.> -i - 



O 
<D 

E 
F 



200- 



100- 



(a) sin(9) by Gyroscope 




5 6 7 8 9 
(b) sin(0) by Vicon 



10 11 




Scale 



Fig, 4 



WO 02/28282 



5/17 



PCT/CH01/00590 




WO 02/28282 



6/17 



PCT/CH01/00590 




WO 02/28282 



7/17 



PCT/CH01/00590 



* i i i i i i i i i i i i ■ i i i i i i i i i i 




0 4 12 20 28 36 44 



Time (sec) 

Fig. 7 



WO 02/28282 



8/17 



PCT/CH01/00590 




WO 02/28282 



9/17 



PCT/CH01/00590 




WO 02/28282 



10/17 



PCT/CH01/00590 



Original 
Signal 



Approximated 
Signal (A^ ) 



Approximated 
Signal (A 2 i) 



H(2°g>) 



+ G(2°<d) 



G(2'a>) 



Detail Signal 
(D 2 i) 



H(2'co) ■—,--> HC^©) 



0(2'©) - 



Detail Signal 
(D 2 i) 



Fig. 10 



WO 02/28282 



11/17 



PCT/CH01/00590 




40 80 120 160 200 

Time (sample) 



Fig. 11 



WO 02/28282 



12/17 



PCT/CH01/00590 



StSi Pattern 




Time (sample) 



Fig. 12 



WO 02/28282 



1 3/1 7 



PCT/CH01/00590 



<x> 



xiy 0 



-1 



^§120 

S100 
— 

Q. 

5 80 



Gyroscope 
. Vic 



neon 




50 100 150 200 250 300 

Time (s) 



Fig. 13 



WO 02/28282 



14/17 



PCT/CH01/00590 



PT Walking Standing 




0 2 4 6 8 10 12 14 

Time (sec) 

Fig. 14 



WO 02/28282 PCT/CH01/00590 

15/17 



CD 



'c/TS 



T3 g 



— CO 
CO 
O) 

jQ ^ 



O) 

c 



ill 





1000 



im 




2000 





3000 4000 
Time (s) 



Fig. 15 



WO 02/28282 



PCT/CH01/00590 



16/17 



afacc 



Acceleration, (gj 

* 

' ■■■ ■ 1 




t t 


1/ — \A~~ 
v v/ 

j 1 


(a) 






Gyroscope Signal 






2. 

fo- 

DC 


"V — V 








2 




Absolute Angle 






0 

40 - 


m/nnr 


. nr : 


(c) 






Variance of af ac c 






0.12 - 
0.08- 
0.04- 


r 
, fin 


. JPl . n- 




(d) 



0 10 20 30 40 50 60 

Time (s) 



Fig. 16 



WO 02/28282 



17/17 



PCT/CH01/00590 




Fig. 17 



INTERNATIONAL SEARCH REPORT 


In itional Application No 




PCT/CH 01/00590 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 A61B5/11 A63B23/02 G08B21/00 



According to International Patent Classification (IPC) or to both national classification and IPC 
B, HELPS SEARCHED ' 

Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 A61B A63B G08B A61C 



Documentation searched other than minimum documentation to the extent that such documents are Included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 

EPO-Internal , WPI Data, PAJ, COMPENDEX, IBM-TDB, INSPEC, BIOSIS 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category • Citation of document, wtth indication, where appropriate, of the relevant passages 



Relevant to dalm No. 



KERR KM WHITE JA BARR DA MOLLAN RAB: 

"Analysis of the sit-stand-sit movement 

cycle 1n normal subjects" 

CLINICAL BIOMECHANICS , GB , BUTTERWORTH 

SCIENTIFIC LTD, GUILDFORD, 

vol. 12, no. 4, 1 June 1997 (1997-06-01), 

pages 236-245, XP004081337 

ISSN: 0268-0033 

abstract; figures 1,2; tables 1-3 
page 239, left-hand column 



US 5 919 149 A (ALLUM JOHN H) 

6 July 1999 (1999-07-06) 

column 8, line 66 -column 9, line 59; 

figures 1-3 



1,3,5,6 



2,4,7-10 
2,4,7-10 



V- 



Further documents are listed in the continuation of box C. 



0 



Patent family members are listed In annex. 



• Special categories of cited documents : 

•A' document defining the general state of the art which Is not 
considered to be of particular relevance 

•E" earlier document but published on or after the International 
filing date 

•L* document which may throw doubts on priority claJmfs) or 
which Is c8ed to establish the publication dale of another 
citation or other special reason (as specified) 

•O' document referring to an oral disclosure, use, exhibition or 
other means 

'P B document published prior to the International filing date but 
later than the priority date claimed 



T later document published after the International filing date 
or priority date and not in conflict with the application but 
died to understand the prindple or theory underlying the 
Invention 

'X a document of particular relevance; the claimed Invention 
cannot be considered novel or cannot be considered to 
involve an Inventive step when the document is taken alone 

■V document of particular relevance; the claimed Invention 
cannot be considered to Involve an Inventive step when the 
document is combined wtth one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art 

document member of the same patent family 



Date of the actual completion of the International search 

14 December 2001 


Dale of mailing of the International search report 

27/12/2001 


Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL-2280HVRijswiJk 
Tel. (+31-70) 340-2040, Tx. 31 651 epo nl, 
Fax: (+31-70) 340-3016 


Authorized officer 

Oonsson, P.O. 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



In ttonal Application No 

PCT/CH 01/00590 



C.(Contlnuatlon) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category * Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to dalm No. 



EP 0 849 715 A (GGT GES FUER 

GERONTOTECHNIK MB) 

24 June 1998 (1998-06-24) 

column 2, line 38 -column 3, line 2 

column 6, line 28-31; figure 1 

AMINIAN K ET AL: "PHYSICAL ACTIVITY 
MONITORING BASED ON ACCELEROMETRY: 
VALIDATION AND COMPARISON WITH VIDEO 
OBSERVATION" 

MEDICAL AND BIOLOGICAL ENGINEERING AND 
COMPUTING, GB, PETER PEREGRINUS LTD. 
STEVENAGE, 

vol. 37, no. 3, May 1999 (1999-05), pages 

304-308, XP000827335 

ISSN: 0140-0118 

cited in the application 

abstract; figures 1,3 

* par. 3 "Results", lines 1-8 * 

GB 2 330 912 A (HAUPTVERBAND DER 
GEWERBLICHEN) 5 May 1999 (1999-05-05) 
abstract; figures 2,3,7,16 
page 8, line 3-7 



1,4 



Form PCT/ISA/210 (oontlnualion of second sheet) (July 1992) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



In Uonal Application No 

PCT/CH 01/00590 



Patent document 
cited In search report 



Publication 
date 



Patent family 
member(s) 



US 5919149 
EP 0849715 



Publication 



06-07-1999 NONE 



24-06-1998 



DE 
EP 



19653773 CI 
0849715 A2 



02-07-1998 
24-06-1998 



GB 2330912 


A 


05-05-1999 DE 


29719250 Ul 


07-05-1998 






DE 


19849673 Al 


06-05-1999 






FR 


2770391 Al 


07-05-1999 






SE 


9803701 A 


01-05-1999 






US 


6152890 A 


28-11-2000 



Form PCT/ISA/210 (patent family ernex) (July 1992) 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



